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METHOD FOR EFFICIENTLY CALCULATING TEXTURE 
COORDINATE GRADIENT VECTORS 




CROSS-REFERENCE TO RELATED APPLICATIONS 
[0001] This is a continuation-in-part of co-pending and commonly assigned Patent 
Application Serial Number5§(573,059 filed May 17, 2000, entitled "METHOD AND 
APPARATUS FOR PERFORMTNG H-SPACE BUMP MAPPING SUITABLE FOR 
IMPLEMENTATION WITH H- SP ACfiXIGHTING IN A GRAPHICS PIPELINE OF A 
COMPUTER GRAPHICS DISPLAY SYSTEM," the disclosure of which is hereby incorporated 
herein by reference. The present invention is alsbsrelated to co-pending and commonly assigned 
U.S. Patent Application Serial No. 09/528,700 filed M^rch 17, 2000, entitled "APPARATUS 
FOR AND METHOD OF RENDERING 3D OBJECTS WITH PARAMETRIC TEXTURE 
MAPS," and concurrently filed and commonly assigned U.S. Patent Application Serial No. 

, entitled "SYSTEM AND METHOD FOR RENDERING DIGITAL IMAGES 

HAVING SURFACE REFLECTANCE PROPERTIES," the disclosureXpf which are hereby 
incorporated herein by reference 



TECHNICAL FIELD OF THE INVENTION 
[0002] The present invention generally relates to computer graphics display 
systems and, more particularly, to a system and method for efficiently calculating texture 
coordinate gradient vectors for use in rendering graphical images. 
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BACKGROUND OF THE INVENTION 
[0003] Computer graphics display systems are commonly used for displaying 
graphical representations of objects on a two-dimensional video display screen. Current 
computer graphics display systems provide highly detailed representations and are used in a 
variety of applications. A computer graphics display system generally comprises a central 
processing unit (CPU), system memory, a graphics system and a graphics display screen. More 
specifically, conventional computer graphics systems commonly include a display device having 
a two-dimensional (2D) array of light emitting areas. The light emitting areas are usually 
referred to as "pixels," which is an abbreviation for picture elements. Such a graphics system 
typically employs hardware, software, or both to generate a 2D array of values that determine the 
colors or shades of grey that are to be emitted from the corresponding pixels of the display. 

[0004] Computer graphics systems are commonly employed for the display of 
three-dimensional (3D) objects. Typically, such a system generates what appears to be a 3D 
object on a 2D display by generating 2D views of the 3D object that is modeled in the computer 
memory. The 2D view of a 3D object which is generated at a particular time usually depends at 
least on a spatial relationship between the 3D object and a viewer of the 3D object at the 
particular time. This spatial relationship may be referred to as the view or eye point direction. 
For example, a car is a 3D object having a front and a back. However, whether one can see the 
taillights will depend on the position from which one is viewing the car. A view direction that is 
directly in front of the car will not show the taillights (but may instead show the headlights), 
while a view direction that is directly behind the car will show the taillights. 

[0005] The process by which a computer graphics system generates the values for a 
2D view of a 3D object is commonly referred to as image rendering or scan conversion. In 
typical computer graphics display systems, an object to be presented on the display screen is 
broken down into graphics primitives. Primitives are basic components of a graphics display and 
may include points, lines, vectors and polygons (e.g., triangles and quadrilaterals). Typically, a 
hardware/software scheme is implemented to render, or draw, the graphics primitives that 
represent a view of one or more objects being represented on the display screen. 

[0006] Generally, the primitives of the three-dimensional object to be rendered are 
generated in terms of primitive data by software being executed by the host CPU. For example, 
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when the primitive is a triangle, the software being executed by the host computer defines the 
primitive in terms of the X, Y and Z coordinates of its vertices, the normals of the vertices, N x , 
N y and N z , and the red, green, blue and alpha (R, G, B and a) color values of each vertex. Alpha 
is a transparency value. Additional primitive data may be used in specific applications. 
Rendering hardware interpolates all of this data to compute the display screen pixels that 
represent each primitive, and the R, G, B and a values for each pixel. 

[0007] Thus, conventional graphics systems usually render a 3D object by 
subdividing the 3D object into a set of polygons and rendering each of the polygons individually. 
The values for a polygon that are rendered for a particular view direction usually depend on the 
surface features of the polygon and the effects of the lighting on the polygon. The surface 
features often include details such as surface colors and surface structures. The effects of 
lighting usually depend on a spatial relationship between the polygon and one or more light 
sources. This spatial relationship may be referred to as the light source direction. For example, 
if there is only one light source, the side of the object closest to the light source will be 
illuminated while the side of the object furthest from the light source might be in shadow. 

[0008] Typically, the evaluation of the effects of lighting on an individual pixel in a 
polygon for a particular view direction involves a number of 3D vector calculations. One of 
ordinary skill in the art will recognize that the standard Blinn/Phong lighting equation is 
commonly used in computer graphics for performing lighting calculations for graphical images. 
Lighting calculations based on the Blinn/Phong equation generally includes floating-point, 
square-root and divide operations when used with normalized vectors. Such calculations are 
usually time consuming and expensive whether performed in hardware or software. 

[0009] One conventional method for reducing such computational overhead is to 
evaluate the effects of lighting at just a few areas of a polygon, such as the vertices, and then to 
interpolate the results across the entire polygon. Examples include methods which are 
commonly referred to as flat shading and Gouraud shading. Such methods usually reduce the 
number of calculations that are performed during scan conversion and thereby increase rendering 
speed. Unfortunately, such methods also usually fail to render shading features that are smaller 
than the areas of individual polygons. If the polygons are relatively large, the view will be 
noticeably distorted. 
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[0010] One conventional method for rendering features that are smaller than the 
area of a polygon is to employ what is referred to as a texture map. In general, a texture refers to 
a graphics data structure which models the surface appearance of an object. A texture may 
represent the visual experience of many materials and substances (e.g., terrain, plants, minerals, 
fur, and skin). Textures may be created digitally by sampling a physical surface utilizing 
photographic techniques. Alternatively, textures may be created manually utilizing a suitable 
graphics design application. Texture mapping involves mapping the surface appearance to a 
graphical surface modeled by a 3D structure. A typical texture map is a table that contains a 
pattern of color values for a particular surface feature. For example, a wood grain surface feature 
may be rendered using the surface and a texture map that holds a color pattern for wood grain. 

[0011] Texture mapping may be utilized for any number of applications. For 
example, texture mapping may be utilized by an architectural software application to generate a 
realistic depiction of a building based upon blueprint designs. For instance, a stucco texture may 
be wrapped onto a building frame by the architectural software application. Texture mapping 
may be additionally used to create special effects for movies, video game animation, website 
wallpapers, and/or the like. Texture mapping is desirable for these applications because it 
facilitates the representation of an object with an appreciable amount of realism and detail. 
Moreover, texture mapping may impart 3D qualities to the computer generated image. 

[0012] Texture mapping algorithms involve wrapping a texture over the surface of 
a model. Specifically, a 3D model or data structure of an object is created. For example, Fig. 1 A 
depicts exemplary object 101 in R3 (i.e., 3D real space). The surface of object 101 may be 
represented as a set of polygons (typically triangles) in 3D space. The polygons are represented 
by their various vertexes. The vertexes are defined by coordinates in K3. For example, vertex 
102 is defined by (Xi, Yi, Z x ) and vertex 103 is defined by (X 2 , Y 2 > Z 2 ). 

[0013] As described above, most computer displays are only capable of displaying 
a 2D view of such 3D object 101. Accordingly, a mapping function is utilized to map the 
coordinates in M 3 to coordinates in R 2 (i.e., 2D real space). Typically, the mapping occurs by 
defining a view angle. Fig. IB depicts such a mapping from object 101 to object 104. Vertex 
102 is mapped to vertex 105 where vertex 105 is defined by two coordinates (X3, Y3). Likewise, 
vertex 103 is mapped to vertex 106 where vertex 106 is defined by two coordinates (X4, Y 4 ). The 



25057455.1 



4 



Attorney Docket No. 10015870-1 PATENT 

mapping function allows the data to be represented in a form that may be displayed by a 
computer display. 

[0014] Concurrently with the mapping, a texture is applied within the confines of 
the polygons of object 104 to provide a realistic appearance. For example, texture 201 of Fig. 2 
may be applied to the polygons of object 104 to create a stone-like appearance. Texture 201 is 
typically implemented as a matrix of red-green-blue (RGB) values. The RGB values are mapped 
utilizing a suitable mapping function to the interior of the polygons of object 104. The final 
graphical image appears to have texture 201 "wrapped" around object 104. 

[0015] However, this approach is limited as the final graphical image, to an extent, 
appears flat. Specifically, the graphical image does not appreciably vary in response to a change 
in illumination direction. Since it does not appreciably change under these conditions, localized 
shading or occlusions are not evident. Moreover, interreflections due to surface irregularities are 
not perceived. 

[0016] Bump mapping is one texture mapping technique that addresses these 
limitations. Bump mapping involves creating a bump map of displacement values. The 
displacement values are utilized to perturb the surface normal vector. The perturbed surface 
normal vector is utilized to render shading in accordance with the Blinn/Phong lighting equation. 

[0017]\As is well known in the art, texture mapping techniques generally utilize a 
coordinate system for niapping a texture onto a 3D graphical object. For instance, in rendering a 
texture represented as po^gons (e.g., triangles), a texture mapping technique may use a 
3Dcoordinate system formeosby the surface normal vector, tangent vector, and binormal vector 
for each vertex. Further, as is well known in the art, texture coordinate gradient vectors are 
commonly computed for orientingHhe texture within the coordinate system of the texture 
mapping technique. Thus, in rendering the texture, a texture mapping technique, such as a bump 
mapping technique, may compute texture coordinate gradient vectors for each polygon (e.g., 
triangle) that forms the texture being rendered in order to properly orient the texture within the 
texture mapping's coordinate system. It should be appreciated that the 3D object onto which the 
texture is being mapped may comprise many polygons. Because the texture coordinate gradient 
vectors are computed for each of the polygons, mu&h computation may be associated with the 
computation of such coordinate gradient vectors. Thefc^fore, it is desirable to provide a method 
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for efficiently computing coordinate gradient vectors in order to optimize the efficiency of the 
rendering process. \ 



BRIEF SUMMARY OF THE INVENTION 
[0018] One embodiment of the present invention provides a method for rendering a 
three-dimensional (3D) graphical image. The method comprises representing the 3D graphical 
image as a plurality of graphics primitives, each having a plurality of vertices. For each of said 
plurality of graphics primitives each having a plurality of vertices, at least two texture coordinate 
gradient vectors are computed. Additionally, for each vertex of the plurality of graphics 
primitives, the method comprises determining a 3D coordinate frame, wherein such determining 
step includes using the at least two texture coordinate gradient vectors computed for the 
respective graphics primitive for orienting the 3D coordinate frame. Thereafter, the method 
comprises utilizing at least the 3D coordinate frame to determine parameters of a parametric 
texture mapping function. 



BRIEF DESCRIPTION OF THE DRAWINGS 
[0019] Fig. 1 A depicts an exemplary object in R 3 according to the prior art. 

[0020] Fig. IB depicts an exemplary mapping of polygons into M2 based on the 
object depicted in Fig. 1 A according to the prior art. 

[0021] Fig. 2 depicts an exemplary texture according to the prior art. 

[0022] Fig. 3 provides a simple example of a triangle that may be used in 
displaying a texture (or other graphics object), which illustrates texture coordinate gradient 
vectors for such triangle. 

[0023] Fig. 4 provides another simple example of a triangle that may be used in 
displaying a texture (or other graphics object), which illustrates texture coordinate gradient 
vectors for such triangle. 
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[0024] Fig. 5 illustrates a functional block diagram of a typical computer graphics 
display system. 

[0025] Fig. 6 depicts a block diagram of an exemplary graphics system 15 of Fig. 5 
in which embodiments of the present invention may be implemented. 

DETAILED DESCRIPTION OF THE INVENTION 
[0026] In general, texture mapping has gained much appreciation because of the 
computational efficiency of many texture mapping techniques in rendering graphical images. 
That is, many texture mapping techniques are computationally more efficient than non-texture 
mapping techniques for rendering graphical images, such as very complex geometry techniques 
(e.g., using very many tiny triangles) and radiosity (ray-traced lighting algorithms). Thus, 
because of their computational efficiency, texture mapping techniques may enable graphical 
images to be rendered much more quickly than non-texture mapping techniques. As described 
above, bump mapping is one texture mapping technique. More recently, another technique, 
known as parametric texture mapping ("PTM"), has been developed for performing texture 
mapping in a manner that renders greater realism than the bump mapping technique. 

[0027] In general, PTM is a computer algorithm for rendering objects using a 
two-dimensional representation of light. PTM is often desirable because it produces quite 
realistic images based on material properties while employing reasonable computational 
complexity. Additionally, it shall be appreciated that the PTM algorithm is capable of producing 
appreciably greater realism for graphical images than many other graphical rendering techniques, 
such as those employing RGB encoding techniques and bump mapping. 

[0028] In texture maps, such as a PTM, a texture may be represented as a matrix 
of discrete components called "texels," which refer to texture elements. Texels may be 
understood as being analogous to pixels. In a traditional RGB texture, a texel is an RGB 
component. In PTM, texels generally are more complex data structures which contain lighting 
information. In a luminance PTM (which is described further below), the data associated with a 
texel generally comprises six coefficients and an RGB component. In a RGB PTM (which is 
described further below), the data associated with a texel generally comprises 6 coefficients for 
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each color channel (R, G, B), resulting in a total of 18 coefficients for a texel. The lighting 
information included in PTMs may be used to reconstruct the surface color under varying light 
conditions. By encoding lighting information in this manner, PTM textures may permit 
perception of surface deformations. Additionally, PTM textures may permit perception of self- 
shadowing and interreflections. PTM textures may also simulate other optical effects such as 
anisotropic and Frensel shading models. 

[0029] Generally, in PTM, each texel is defined by a biquadric function with six 
coefficients. The texels are represented by the following form: 

PTM(w,v) = Aw 2 + Bv 2 + Cuv + Dm + Ev + F, 



where u and v represent scalar quantities associated with orthogonal components of a vector in a 
plane. For example, u and v may represent the intensity of light from two different directions 
where the texel is rendered on a three-dimensional object or model. Specifically, a light source 
is first determined to be illuminating the texture which, for example, may be wrapped on the 
three-dimensional object. The light source is defined as being positioned at a location relative to 
the texel being illuminated in the direction defined by illumination vector, L. Illumination 
vector, L 9 is typically a unit vector. Secondly, surface normal vector, S 9 is determined (which is 
also typically a unit vector). The projection of illumination vector, L, onto the plane defined by 
surface normal vector, S, is determined. The projection may be represented as two orthogonal 
vector components on the plane defined by surface normal vector, 5. The two orthogonal vector 
components are respectively associated with the scalar values, u and v. Thus, the projection of 
illumination vector L onto the plane defined by surface normal vector S comprises components l u 
and l v . 

[0030] The coefficients of the texel representation equation, A-F, of the PTM 
texture function described above may be determined by repeatedly sampling a surface. For 
example, a physical stone surface may be digitally photographed a number of times utilizing 
different illumination angles. The coefficients, A-F, may then be determined from the digital 
information utilizing a least square approximation. Singular value decomposition (SVD) may be 
utilized to perform this analysis. Further details regarding implementation of PTM algorithms 
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are disclosed in U.S. Patent Application Serial No. 09/528,700, entitled "APPARATUS FOR 
AND METHOD OF RENDERING 3D OBJECTS WITH PARAMETRIC TEXTURE MAPS." 

[0031] In certain implementations, the preceding PTM function may define the 
brightness of a texel, while the chromaticity remains constant. It shall be appreciated, however, 
that in other implementations separate functions may be defined for red, green, and blue (RGB) 
chromatic components or channels. The separate functions may be used to calculate gray-level 
intensities of the RGB channels. According to such an approach, three separate functions are 
each evaluated according to u and v as determined by the same surface normal vector, S, and the 
same illumination vector, L. Generally, it is advantageous to cause the chromaticity to remain 
independent of u and v, because this approach reduces the computational complexity of the 
algorithm. 

[0032] Although PTM textures were primarily developed for three-dimensional 
texture mapping applications, PTM textures are not limited to three-dimensional applications. 
For example, PTM textures may be utilized to perform image enhancement. PTM textures may 
also be utilized to interactively control lighting conditions to promote increased perception of 
surface characteristics. As onte example, PTM may be utilized to provide an efficient method for 
rendering graphical objects with^ surface reflectance properties (e.g., PTM may be implemented 
for modeling a Bidirectional Reflectance Distribution Function), such as disclosed in 

concurrently filed and commonly assigned U.S. Patent Application Serial No. , 

entitled "SYSTEM AND METHOD FOR RENDERING DIGITAL IMAGES HAVING 
SURFACE REFLECTANCE PROPERTIES." In certain embodiments of the present invention, 
PTMs may be implemented having four (or more) independent variables, and the PTMs may be 
parameterized in different ways depending^! the independent variables implemented therein. 
For instance, in certain embodiments PTMs may include four independent variables with two 
independent variables used for indexing the PTM and the other two independent variables used 
to evaluate the PTM function. For example, a PTM may be parameterized using independent 
variables for representing light direction (e.g., l u and / v ) and independent variables for 
representing surface position (e.g., with texture coordinates s and t). The surface position may 
be used to index the texture, e.g., using texture coordinates (s, /). An example of such a PTM 
may take the form: 

PTM(s,t,l u ,l v ) = A(s,i)l u 2 + B(s,t)l v 2 + C(s,t)lJ v + Dfy,t)l u + E(s,t)l v + F(s,t). 
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As with the variables and v described above, /„ and l v represent scalar quantities associated with 
orthogonal componentsyof a vector. For example, l u and l v may represent the intensity of light 
from two different directions where the texel is rendered on the three-dimensional object, as 
described above. And, s and t represent texture coordinates that identify a position on the 
texture. Independent variables l u and l v for representing the light direction may be determined as 
follows: l u = Dot(light, tangent) and l v = Dot(light, binormal). Thus, independent variable /„ is 
the dot product of the light and tangent vectors, while variable l v is the dot product of the light 
and binormal vectors. * 

[0033] As another example, a PTM may be parameterized using independent 
variables for representing light direction (e.g., l u and / v ) and independent variables for 
representing view direction (e.g., v u and v v ). That is, a view vector Fmay be defined, which 
when projected into the plane defined by surface normal vector S comprises components v M and 
v v . In such case, independent variables for representing the light direction, l u and / v , may be 
determined in the manner described above, wherein: l u = Dot(light, tangent) and l v = Dot(light, 
binormal). Further, independent variables for representing the view direction, v„ and v v , may be 
determined as follows: v u = Dot(view, tangent) and v v = Dot(view, binormal). Thus, independent 
variable v u is the dot product of the view and tangent vectors, while variable v v is the dot product 
of the view and binormal vectors. One of the (w, v) pair may be used to index the texture, while 
the other (w, v) pair may be used to evaluate the PTM function, /(w, v). 

[0034] As still another example, a PTM may be parameterized using independent 
variables for representing a half-angle vector (e.g., h u and h v ) and independent variables for 
representing a difference vector (e.g., d u and d v ). In general, a half-angle vector H is halfway 
between the view and light vectors, and is defined as: H=|L+V|. The difference vector D is such 
that L=H+D and V+H-D. When projected into the plane defined by surface normal vector S, 
Half-angle vector H comprises components h u and h v and difference vector D comprises 
components d u and d v . 

[0035] In such case, independent variables for representing the half-angle vector, h u 
and h v , may be determined as follows: h u = Dot(half-angle, tangent) and h v = Dot(half-angle, 
binormal). Further, independent variables for representing the difference vector, D u and D V9 may 
be determined. As described above, the difference vector (D) is such that: L=H+D and V=H-D. 
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Thus, D u is the u component of the projection of the difference vector (D) into the plane defined 
by the normal vector (S), and D v is the v component of the projection of the difference vector (D) 
into the plane defined by the normal vector (S). The (Hu, Hv) pair may be used to index the 
texture, while the (£>«, Dv) pair may be used to evaluate the PTM function, /(«, v). 

[0036] Embodiments of the present invention utilize PTMs for rendering graphical 
images (e.g., for rendering textures). As with traditional texture mapping techniques, such as 
bump mapping, PTM techniques generally utilize a coordinate system for mapping a texture onto 
a 3D graphical object. For instance, in rendering a texture onto a 3D graphical object 
represented as polygons (e.g., triangles), the PTM texture mapping technique generally uses a 
coordinate system formed by the surface normal vector, tangent vector, and binormal vector for 
each vertex of the polygons. Further, as with traditional texture mapping techniques, such as 
bump mapping, texture coordinate gradient vectors are generally computed for orienting the 
texture within the coordinate system of the PTM. Thus, in rendering the texture, the PTM 
generally computes texture coordinate gradient vectors for each of the polygons (e.g., triangles) 
that form the texture being rendered in order to properly orient the texture within the PTM's 
coordinate system. After calculating the texture coordinate gradient vectors for a polygon, a 3D 
coordinate frame (e.g., comprising surface normal vector, tangent vector, and binormal vector) is 
generally calculated for each vertex of the polygon. The texture coordinate gradient vectors 
computed for a polygon are used to orient the 3D coordinate frame for each vertex of the 
polygon. The process of rendering a graphical image using a PTM in accordance with 
embodiments of the present invention is further described below. 

[0037] In general, the process of rendering a texture using a PTM comprises the 
following steps: 

[0038] Step 1 : Calculate texture coordinate gradient vectors for each graphics 
primitive (e.g., each polygon, triangle, etc.) of the texture. The calculation of such texture 
coordinate gradient vectors in accordance with embodiments of the present invention is further 
described herein below. 

[0039] Step 2: Determine a 3D coordinate frame for each vertex of the graphics 
primitives. For example, such 3D coordinate frame is generally formed by a surface normal 
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vector, tangent vector, and binormal vector. It should be understood that the texture coordinate 
gradient vectors are utilized in properly orienting the 3D coordinate frame for each vertex. 

[0040] Step 3: Calculate (/ w , / v ) per vertex of the graphics primitives: 
l u = Dot(light, tangent); and 
l v = Dot(light, binormal) 

[0041] Step 4: Interpolate (/„, l v ) for each pixel in the interior of the graphics 
primitives, and interpolate (s, t) texture coordinates for each pixel in the interior of the graphics 
primitives. 

[0042] Step 5 : For each pixel, use interpolated (s, t) texture coordinates to look up 
biquadric polynomial coefficients from the PTM texture (A,B,C,D,E,F), and use interpolated (/„, 
/ v ) values to evaluate the PTM's biquadric polynomial(s). Generally, PTM functions may be 
defined as either RGB PTMs or Luminance PTMs. With RGB PTMs, separate functions are 
defined for red, green, and blue (RGB) chromatic components or channels. That is, there is a 
unique biquadric polynomial for each of the three color channels, such as: 

[0043] R = A R l 2 u + B R l 2 v + C R IJ V + D R l u + E R l v + F R 

G = A G f u + B G ll + C G IJ V +D G l u + E G l v + F G 

B = A B ll + B B l 2 v + C B IJ V + D B l u + E B l v + F B , 
wherein a separate function is provided for defining the red (R), green (G), and blue (B) color 
channels. The separate functions may be used to calculate gray-level intensities of the RGB 
channels. According to this approach, three separate functions are each evaluated according to /„ 
and / v . 

[0044] In luminance PTMs, a PTM function is provided that defines the brightness 
of a texel, while the chromaticity remains constant. That is, for luminance PTMs one biquadric 
polynomial is provided that determines a luminance value, which may then be applied to the 
RGB color channels, such as: 

[0045] Luminance = A(/ w 2 ) + B(/ v 2 ) + C(IJ V ) + D(/ tt ) + E(/ v ) + F 

[0046] R' = Rx Luminance 
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[0047] G' = Gx Luminance 

[0048] B' = Bx Luminance 
wherein the Luminance value is applied to red (R), green (G) 5 and blue (B) color channels to 
render realistic color channels R f , G 1 , and B* to be used in rendering the graphical image. It may 
be advantageous to cause the chromaticity to remain independent of u and v, as with luminance 
PTMs, because this approach reduces the computational complexity of the algorithm. 

[0049] The above provides an exemplary process for rendering a graphical object 
(e.g., texture) using a PTM. It should be appreciated that the graphical object (e.g., texture) may 
comprise many polygons, and the texture coordinate gradient vectors are computed for each of 
the polygons, which may result in much of the computation associated with the rendering 
process being computation of such texture coordinate gradient vectors. Therefore, embodiments 
of the present invention provide a method for efficiently computing such texture coordinate 
gradient vectors, which are preferably utilized to further enhance the efficiency of PTMs in 
rendering graphical images (e.g., in rendering textures). 

[0050] While those of ordinary skill in the art will be familiar with the use of 
texture coordinate gradient vectors in computer graphics rendering (e.g., in texture mapping), a 
relatively simple example of utilizing texture coordinate gradient vectors in accordance with 
embodiments of the present invention is provided in Figs. 3 and 4. Figs. 3 and 4 each provide a 
very simple example of a triangle that may be used in displaying a texture (or other graphics 
object). It should be understood that the triangles of Figs. 3 and 4 are actually represented in 3D 
in practice, but expressed in Figs. 3 and 4 in the 2D representation of the texture (i.e., in 
accordance with the texture coordinate system defined by S and T. The 2D texture coordinates 
(s, t) for the vertices of the triangles are shown in Figs. 3 and 4. For example, the triangle of Fig. 
3 has vertices at texture coordinates (0,0), (1,0), and (0,1), and the triangle of Fig. 4 has vertices 
at texture coordinates (1,0), (0,0), and (1,1). 

[0051] As described above, in the PTM process, a 3D coordinate frame is 
determined for each vertex of the triangle. More specifically, a 3D coordinate frame formed by a 
surface normal vector, tangent vector, and binormal vector is generally determined for each 
vertex. In the relatively simple examples of Figs. 3 and 4, the normal vectors are all pointed 
directly up from the page. This is a simplification, as in practice the normal vectors for a triangle 
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do not usually all point in the same direction. Generally, the rendering process (e.g., the PTM 
rendering process) is provided the texture coordinates 0, f) and normal vectors for the vertices of 
a triangle. The rendering process then calculates the tangent and binormal vectors for each 
vertex. As described above and as is illustrated in the examples of Figs. 3 and 4, the normal, 
tangent, and binormal vectors are each perpendicular to one another and form a 3D coordinate 
frame. 

[0052] In tietermining such 3D coordinate frame, the computed texture coordinate 
gradient vectors for a triangle are used to properly orient the 3D coordinate frame for each vertex 
of the trianglel. In embodiments of the present invention, two gradient vectors are computed for 
each triangle of a graphical object. One gradient vector ("G s ") is computed which identifies the 
direction of "maximum change" in the s texture coordinate, and the other gradient vector ("G,") 
is computed which identifies the direction of "maximum change" in the t texture coordinate. In 
this sense, the direction of "maximum change" refers to the direction in which a component of 
the texture coordinate (i.e., s or A changes the fastest. For instance, in the example of Fig. 3, 
gradient vector G s is determined as being directed along texture coordinate s in the direction 
from texture coordinate (0,0) to texmre coordinate (1,0). Similarly, gradient vector G, is 
determined as being directed along texture coordinate t in the direction from texture coordinate 
(0,0) to texture coordinate (0,1). The determined texture coordinate gradient vectors for the 
triangle shown in Fig. 4 are illustrated traerein. 

[0053] The computed texture coordinate gradient vectors (G s and G t ) for a triangle 
are used by the rendering process to properly determine the orientation of the 3D coordinate 
frame for each vertex of the triangle. In embodiments of the present invention, the tangent 
vector is determined to be perpendicular to the normal vector, and it is determined to be directed 
in the general direction of the s texture coordinate gradient vector (G s ). Similarly, the binormal 
is perpendicular to both the normal and tangent vectors, and it is determined to be directed in the 
general direction of the t texture coordinate gradient vector (G,). 

[0054] The difference between the examples shown in Figs. 3 and 4 is in the 
assignment of the texture coordinates for each triangle. In the example of Fig. 3, the texture 
coordinates are assigned in a traditional left-to-right and bottom-to-top manner. In other words, 
the s texture coordinates increase in value from left to right, and the t texture coordinates 
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increase in value from bottom to top. Fig. 4 has texture coordinates assigned such that the 
texture is flipped from left to right. That is, the s texture coordinates increase in value from right 
to left. 

[0055] Because of the change in orientation of the triangle in Fig. 4 from that of 
Fig. 3, the texture coordinate gradient vectors G s and G, are different in Fig. 4. The first effect of 
such a change is that the calculation of the tangent vector changes for the vertices of the triangle 
of Fig. 4. It should be noted thattthe tangent vector for each vertex in Fig. 4 has changed from 
the tangent vector determined for each vertext in the example of Fig. 3. It should be recognized 
that the orientation along the t texture coordinate has not changed from Fig. 3 to Fig. 4, and 
therefore the binormal vector remaibs the same for each vertex. Of course, if the orientation of 
the triangle in Fig. 4 had a different orientation along the t texture coordinate, the binormal 
vector would change. \ 

[0056] Because of the change in the tangent vector in Fig. 4 from that of Fig. 3, the 
calculation of l u changes (it should be recalled that l u is the dot product of the light vector and 
tangent vector). Of course, if a change occurred with the binormal vector, the calculation of l v 
would change, as l v is the dot product of the light vector and the binormal vector. As a result of 
the change in / w , the evaluation of the PTM's biquadric polynomial(s) changes such that features 
of the PTM that are oriented to the right in Fig. 3 are oriented to the left in Fig. 4. 

[0057] It should be understood that the examples provided in Figs. 3 and 4 are very 
simplified. In practice, vertex normal vectors for a triangle do not generally all point in the same 
direction. Further, the triangles are generally represented in 3D, and the resulting texture 
coordinate gradient vectors G s and G t are also generally calculated in 3D. Further, the resulting 
tangent and binormal vectors are also generally calculated in 3D. 

[0058] As described above, texture coordinate gradient vectors are generally 
computed for each graphics pmnitive (e.g., triangle) of a graphical object to be rendered using 
PTM. For instance, texture coordn^ate gradient vectors are generally computed for each graphics 
primitive of a 3D object onto which a^exture is being mapped. Because a graphical object may 
include many such graphics primitives and texture coordinate gradient vectors are computed for 
each of such graphics primitives, embodiments of the present invention utilize an efficient 
method for computing the texture coordinate gradient vectors to further improve the rendering 

25057455.1 15 \ 



• # 

Attorney Docket No. 10015870-1 PATENT 

efficiency of a PTM. A method for efficiently computing texture coordinate gradient vectors is 
disclosed in co-pending ana commonly assigned Patent Application Serial Number 09/573,059, 
entitled "METHOD AND APPARATUS FOR PERFORMING H-SPACE LIGHTING IN A 
GRAPHICS PIPELINE OF A COMPUTER GRAPHICS DISPLAY SYSTEM," from which this 
application is a continuation-in-part. In accordance with various embodiments of the present 
invention, such method for efficiently computing texture coordinate gradient vectors is utilized 
for computing texture coordinate gradient vectors for use with PTMs (as well as other texture 
mapping techniques in which thel resulting texture varies responsive to its orientation relative to a 
light vector) for rendering graphical objects. Accordingly, the method for efficiently computing 
texture coordinate gradient vectori is further reiterated herein below. 

[0059] In the below description, the variables (s, t) are texture coordinates for a 
given triangle vertex. The texture coordinate gradient vector, G s , associated with the s texture 
coordinate is defined as the vector: {ds/dX, ds/dY, ds/dZ}, where X, Y and Z correspond to eye 
coordinates. That is, the derivative {ds/dX, ds/dY, ds/dZ} corresponds to texture coordinate 
gradient vector G s . The texture coordinate gradient vector, G t associated with the t texture 
coordinate is defined as the vector: {ds/dX, ds/dY, ds/dZ}. The G t texture coordinate gradient 
vector is calculated in order to determine which direction is "up" in the local coordinate system. 

[0060] The preferred manner in which these gradient vectors are calculated will 
now be described with reference to pseudo code. It should be noted that the gradient calculations 
are generally performed prior to performing the PTM texture mapping algorithm of the present 
invention (e.g., see Step 1 of the above rendering process). 

[0061] In the gradient calculations represented by the pseudo code below, XYZo 
represented the (x,y,z) coordinates associated with vertex 0. Similarly, XYZi and XYZ2 
represent the (x,y,z) coordinates associated with vertices 1 and 2, respectively. STo represents 
the (5, t) texture coordinates associated with vertex 0. ST] and ST2 represent the (s, t) texture 
coordinates associated with the vertices 1 and 2, respectively. 

Calculation of the Texture Coordinate Gradient Vectors 

G s represents the texture coordinate gradient vector for the s texture coordinates 
G t represents the texture coordinate gradient vector for the t texture coordinates 

XYZo 



25057455.1 



16 



Attorney Docket No. 10015870-1 PATENT 



XYZi these are the (x, y, z) vertex positions 

XYZ 2 

ST 0 

STi these are the (s, t) vertex texture positions 

ST 2 

Di is the vector from vertex 0 to vertex 1 
D 2 is the vector from vertex 0 to vertex 2 

T] is the texture coordinate delta from vertex 0 to vertex 1 
T 2 is the texture coordinate delta from vertex 0 to vertex 2 
Woo is the dot product of Di with itself 
W01 is the dot product of Di and D 2 
Wi 1 is the dot product of D 2 with itself 

Di =XYZj -XYZ 0 
D 2 = XYZ 2 -XYZ 0 

Ti = STi - ST 0 
T 2 - ST 2 - ST 0 

W 00 = Di *Di 
W 0 i=Di«D 2 
Wi, = D 2 »D 2 

Denom = 1 / (W 00 * W n - W 0 i * W 0 i) 
p s = (Tis * Wn + T 2 s * W01) * denom 
q s = (T 2 s * Woo + TiS * W 0 i) * denom 
G s = p s *D 1 +q s *D 2 
p t = (Tjt * Wi 1 + T 2 t * W01) * denom 
q t = (T 2 t * Woo + Tit * W01) * denom 
Gt = p t *D,+q t *D 2 

[0062] It should be recognized that the above calculations may be utilized to 
efficiently compute texture coordinate gradient vectors G s and G t . Further description of the 
above calculations used in computing texture coordinate gradient vectors is now provided, which 
details how the above calculations may be arrived at and how they increase the efficiency of the 
computation of texture coordinate texture coordinate gradient vectors G s and G t While the above 
computations and the below description refer to computing gradient vectors for triangles, it 
should be understood that such computation method may be utilized for computing texture 
coordinate gradient vectors for any graphics primitive. 
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[0063] For each triangle vertex, texture coordinates (s, t) and vertex location (x, y, 
z) are input to the texture coordinate gradient vector calculation. The values for the three 
vertices of a triangle are represented as: 

first vertex: (x 0 ,yo,zo) (Wo); 

second vertex: (xi,yi,zi) (s\,t\); and 

third vertex: (x 2 ,y 2 ,z 2 ) (s 2 ,/ 2 ). 

[0064] The change in vertex location and texture coordinates is represented as: 
Di=(xi,yi,zi)-(xo,yo,zo) (i.e., the vector from vertex 0 to vertex 1), 
Ui=^i-5o and V\=t\-t$\ and 

D 2 =(x 2 ,y 2 ,z 2 )-(x 0 ,yo,zo) (i.e., the vector from vertex 0 to vertex 2), 

U 2 =s 2 -so and F2 = *2-*o- It should be recognized that (Ui,Vi) corresponds to Ti in the above 
computations, and (U 2 ,V 2 ) corresponds to T 2 in the above computations. 

A property of the gradient vector is that the dot product of the gradient vector and any 
other vector on the surface of a triangle will be the change in texture coordinates, such that: 





D 1Y D 1Z 
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[0065] In the above example, (A,B,C) is the gradient vector. This results in a 
system of two equations and three unknowns, which alone is not enough to calculate the gradient 
vector. The gradient vector can be represented as a linear combination of the two vectors Di and 
D 2 . This is used to rewrite the above system of equations to result in a system of two equations 
and two unknowns (i.e., linear combination variables P and Q) 9 as follows: 



[0066] 
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[0067] It should be understood that linear combination variables P and Q are 
calculated once to determine gradient vector G s and once to determine gradient vector G t . Thus, 
P calculated for gradient vectors G s and G t results in p s and p t , respectively, as used in the above 
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computations, and Q calculated for G s and G t results in q s and q t , respectively, as used in the 
above computations. 

[0068] The above equations may be rewritten as: 



[0069] 
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, wherein: 



Wqo = (D, x , D 1Y , Diz) dot (D 1X , D 1Y , D 1Z ); 
Wox = (Dix, Diy, Diz) dot (D 2X , D 2Y , D 22 ); 
W\o = (D 2 x D 2Y , D 2Z ) dot (D 1X , D, Y , D 1Z ); and 
W u = (D 2X , D 2Y , D 2Z ) dot (D 2X , D 2Y , D 2Z ). 

[0070] It should be recognized that: Wo\^W\o- Therefore, it is unnecessary to 
calculate both Wq\ and W\o independently, but rather in embodiments of the present invention, 
the calculation for determining Wo\ and W\o may be performed once to save the amount of 
computation performed. Thus, the above results in a system of two equations and two unknowns 
P and which may be solved for as follows: 

[0071] Once calculated, P and Q can be used to calculate the gradient vector 
(AJB,C). In the above equations for computing P and Q, it should be recognized that the 
denominators in each equation are the same. Also, two gradient vectors will need to be 
calculated. That is, one gradi^it vector is calculated using U (i.e., G s ) and one gradient vector is 
calculated using F(i.e., G t The denominators in the calculations of P and Q are independent of U 
and V and therefore need to be calculated only once. Thus, because the denominators are the 
same for both P and Q, they only need to be computed once in solving for P and Q. 
Additionally, because P and Q must besdetermined for both U and V and because the 
denominators used in the calculations of /? and Q are independent of U and V, once such 
denominator is computed once, it may be used for both U and V, 
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[0072] As one of ordinary skill in the art will recognize, once the texture coordinate 
gradient vectors are computed, they are generally normalized before being used in subsequent 
calculations. Once computed (and normalized), the texture coordinate gradient vectors may be 
used in orienting a graphics primitive (e.g., triangle) within a coordinate system of a PTM in the 
mariner described above. 

[0073] Turning now to Fig. 3, an exemplary computer graphics display system 10 
is shown, in which embodiments of the present invention may be implemented. The computer 
graphics display system 10 comprises a host CPU 12 connected to an input/output (I/O) 
controller 13, a graphics system 15, a system memory device 16 and a display device 17. The 
CPU 12 communicates with the\system memory 16 and the I/O controller via a system bus 14. 
The graphics system 15 communicates with the I/O controller 13 via I/O bus 16. A user (not 
shown) may communicate with the CPU 12 via a peripheral input device, such as a keyboard or 
mouse, to generate and/or manipulate an image being rendered on the display device 17. 

[0074] An example of components that may be included in graphics system 15 of 
the computer graphics display systemuO in accordance with embodiments of the present 
invention are further shown in Fig. 4. Graphics system 15 includes buffer 412, graphics 
processor 414, parametric texture map 416, frame buffer 418, and display 420. Buffer 412 holds 
geometry data that describes a 3D objectWhich is to be generated on the display 420. Buffer 412 
may be any suitable data storage mechanism now known or later discovered, including as 
examples Random Access Memory (RAMf), cache memory, disk drive, floppy disk, and optical 
disc. The 3D object is represented in the buffer 412 as a set of polygons in a 3D space. In one 
embodiment, the polygons are triangles and\the geometry data in buffer 412 includes the 3D 
coordinates of the vertices of the triangles. 

[0075] Graphics system 15 includes graphics processor 414, which may be any 
suitable processor now known or later discovered, including without limitation any processor 
from the Itanium™ family of processors or a PA-8500 processor available from Hewlett-Packard 
Company. Graphics processor 414 reads the parameters that define the polygons from buffer 
412 and scan converts each polygon. The scan conversion of a polygon yields a 2D view of the 
polygon which depends on a view direction and light source direction. A 2D view of a polygon 
includes a color value for each pixel of the polygon which is visible in the plane of display 420. 
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Graphics processor 414 writes the color values for the rendered polygons into frame buffer 418. 
Frame buffer 414 may be any suitable data storage mechanism, including as examples RAM, 
cache memory, and disk drive. yhe color values from frame buffer 418 may be provided to 
display 420 on a frame by frame basis. Display 420 may be any conventional 2D display device 
now known or later discovered, such as a scan device or flat-panel display device, as examples. 

[0076] Parametric texture map 416 may hold parameters that define a surface 
structure in a manner in which the appearance of the surface structure varies with any user- 
defined vector, such as the view vector, the light source vector, or the half-angle vector. In 
general, the half-angle vector is a vector that is halfway between the view and light source 
vectors. Graphics processor 414 mapstthe surface structure defined in parametric texture map 
416 onto the polygons obtained from buffer 412 during scan conversion. The result is a more 
realistic rendering of 3D features in a surface on a 3D object in comparison to many other texture 
mapping techniques. \ 

[0077] In view of the above, preferred embodiments of the present invention 
provide a system and method for efficiently rendering graphical images using PTMs by utilizing 
an efficient method for calculating texture coordinate gradient vectors. As described above, 
PTMs provide advantages over many other texture mapping techniques, and therefore it is 
desirable to use PTMs for rendering graphical images (e.g., for mapping textures onto a 
graphical object). As with other texture mapping techniques, PTMs utilize a 3D coordinate 
frame that is oriented with texture coordinate gradient vectors. Accordingly, preferred 
embodiments of the present invention provide a system and method that further improve the 
efficiency of PTMs by efficiently computing such texture coordinate gradient vectors used 
within PTMs. 

[0078] In alternative embodiments, the above-described system and method for 
efficiently computing texture coordinate gradient vectors may be used with any texture mapping 
technique in which the resulting texture varies with changes in its orientation relative to a light 
vector, such as well known bump mapping techniques. For instance, the method of efficiently 
computing texture coordinate gradient vectors in accordance with the present invention may be 
used with bump mapping, as described further in U.S. Patent Application Serial No. 09/573,059 
entitled "METHOD AND APPARATUS FOR PERFORMING H-SPACE BUMP MAPPING 



25057455.1 



21 



Attorney Docket No. 10015870-1 



PATENT 



SUITABLE FOR IMPLEMENTATION WITH H-SPACE LIGHTING IN A GRAPHICS 
PIPELINE OF A COMPUTER GRAPHICS DISPLAY SYSTEM" from which this application 
is a continuation-in-part. 
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